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The Analytical Review Project, conducted by UCLA's 
Center for the study of Evaluation under the auspices of the U.S. 
Office of Education, evaluated 20 major longitudinal studies of the 
impact of schools and colleges on students' cognitive, personal, and 
vocational development. This project included a critical appraisal of 
the metfiodology used in each study as well as the studies* findings. . 
The convergence and divergence of findings are reported together with 
underlying methodological problems and recommended methodological 
procedures for suirvey research particularly as they pertain to 
enhanced understanding of the relationship between student 
development and the educational process. The major recommendation is 
that research should go beyond merely identifying causal or 
predictive relationships, which is the current orientation, to 
explicating causal or predictive relationships with analyses that 
tell why a specific relationship exists (interpretation) and what 
conditions maximize and minimize the strength of the relationship 
(specification). (Author/KM) 
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THE USE OP EXPLICATIVE ANALYSIS IN EDUCATIONAL RESEARCH 
Alfred G* Marcus and Clare Rose 
University of California, Los Angeles 

Introduction 

The Analytical Review Project, sponsored by tho 
National Center for Educational Statistics of the U. S. Office 
of Education was designed to analyze several major longitudinal 
studies in order to discover variables, techninues, methodol- 
ogies and problems pertinent to evaluative studies of the 
impact of schools and colleges upon the growth and development 
of young adults. The results of this analysis are reported in 
five volumes cited in the addendum to this paper. Volume I 
contains the theoretical framework of the project^ together 
with highlights of the substantive and methodological issues 
raised by the studies selected for analysis. Volume II con- 
tains the dynamics of the abstracting process utilized in the 
project, the typology of the variables used in the research, 
an overview of the major issues suggested by the research and 
comprehensive summaries or abstracts of each of the studies re- 
viewed. Volume III presents the logic of survey research, the 
major data collection technioue used in the studies t nroblems 



common to survey research » impact analysis Including the problem 
of measuring change » and a critical analysis of the research 
designs 9 methodologies and technioues used in the studies re- 
viewed. In addition^ a checklist of recommended guidelines 
for educational research included which serves concomitantly 
as a means by which survey research studies may be evaluated 
and also as a beginning collection of evaluative criteria. 
The synthesis and implications of the findings including 
matrices of the findings and variables derived from the studies 
under review comprise Volume lY. Volume V consists of a "users 
guide" or reference index to the other four volumes, summary 
of the technical aspects of the research studies and a classi- 
fication of the instruments used in the studies. This paper ' 
focuses upon one of the major issues treated in Volume III; the 
use of explicative analysis in educational research. 

Explicative Analysis 

Almost without exception the search for causal rela- 
tionships has become the primary concern of educational re- 
searchers. Although a causal analysis may indicate that a 
relationship probably exists, it does not necessarily identify 
the reason why a particular variable produces certain effects. 
Thus the researcher may determine that small classrooms con- 
tribute to higher verbal achievement scores, yet be uncertain 
as to the underlying processes responsible for this relet ion- 
ship. Explicative studies attempt to answer this tyoe of re-* 
seaTOb question. The key word in explicative analysis is 



elaboration* Explicative studies are designed to test specific 
hypotheses and thereby to elaborate the relationships between 
variables 9 including the processes, precipitating factors or 
events, and the structural contexts which mediate the relation- 
ships* Explicative analysis is therefore the logical extension 
of causal analysis* Once a causal relationship has been detected, 
the researcher should attempt to explicate this relationship by 
identifying factors which will interpret the relationship and 
specify the conditions that will make it more or less probable* 
Interpretation and SDecification analysis should therefore be 
an integral part of the overall data analysis strategy of the 
educational researcher** The extent to which observed relation* 
ships were statistically interpreted and specified in the Ana-^ 
lytical Review studies Is assessed in the following section* 

Interpretation Analysis 

The contribution of a study is etibanced considerably 
when the analyst can identify the reasons vrtiy a particular 
relationship exists* This is especially true in educational 
research where knowledge of the underlying processes responsible 
for a relationship is necessary before sound policy decisions 
can be made* Statistical interpretation attempts to identify 
and clarify these underlying processes by introducing additional 
test factors into the analysis* 

''^or excellent discussions of specification and inter* 
pretation analysis, see, Paul Lazarsfeld and Morris Rosenberg, 
The Language of Social Research * New York: The Free Press, 1955, 
Section II, pp* 115-125; Herbert H* Hyman, Swvey Design and 
Analysis * New York: The Free Press, 1955f Ch* 7, PP* 275-327; 
Morris Rosenberg, The Logic of Survey Analysis * New York: Basic 
Books, Inc*, 1968; and C* Y* Glock- (ed*}^ Survey Research in the 
Social Sciences * New York: Russell Sage Foundation, 1967. 



To perform interpretation analysis upon a two variable 
relationship the researcher statistically controls or reduces 
the effects of an interpretation test factor — a third variable 
that intervenes in temporal sequence between the independent 
and dependent variable. When successful interpretation occurs ^ 
the original relationship is sharply reduced or disappears 
When the effects of the interpretation test factor are statis- 
tically^ controlled. 

Although interpretation analysis can make important 
substantive contributions to educational research ^ the Analytical 
Review indicates that analysts were not systematically testing 
interpretation hypotheses. The studies reviewed did contain 
attempts at statistical interpretation > but for the most part 
they remiain isolated attempts lacking the necessary integration 
witb causal analysis to become a viable research strategy for 
understanding the dynamics of human growth and developnent. 

Examples of interpretation analysis can be found in 
Coleman (1966), Sbaycoft (196?) and Bacbman (1970). Coleman 
found that minority students attending integrated schools 
scored bi^er on achievement tests than did minority students 
attending segregated schools even when the effects of social 
class were statistically reduced. This important finding 
merited further Investigation to determine why integrated 
schools bad this effect* 

Several plausible interpretations were advanced to ex* 
plain this observation. Minority students might have achieved 
bi^er scores in integrated schools because predominately White 
schools have better physical facilities^ higher quality teaching 



staffs or more remedial courses. Dif ferences . with the peer 
environments of integrated and segregated schools could also 
have accounted for the greater achievement of minority students 
in integrated schools. The peer group in integrated schools 
compared to segregated schools may have encouraged and rewarded 
academic excellonce to a much greater extent thereby motivating 
the minority students to perform better scholastically. 

♦ To determine which of these competing hypotheses was 
most credible, Coleman performed an interpretation analysis 
iriiicb has become a classic example of this testing procedure 
in educational research and clearly illustrates that important 
information can be obtained by systematically searching for 
interpretation variables. The results of Coleman ♦s analysis 
revealed that it was the influence of the peer group, rather 
than the Impact of the physical resources of the school or the 
quality of the teaching staff, which accounted for the rela- 
tionship between school integration and academic achievement. 
In the words of Coleman ; 

The higher achievement of all racial and ethnic 
groups in schools with greater proportions of white 
students is not accounted for by better facilities 
and curriculum in their schools. . . . The higher 
achievement of all racial and atbnic groups in 
schools with greater proportions >f white students 
is largely, perhaps wholly, related to effects 
associated with the student body's educational 
background and aspirations (p. 307). 

Thus, whien the differential effects of various school 
resources were statistically controlled, the observed differ- 
ences in the academic achievement of minority students attending 
integrated and segregated schools remained* However, when the 
effects of the educational aspirations and achievements of the 



student body were statistically reduced, the differences which 

had prev.lously existed in the educational achievements of these 

students* disappeared* This is strong evidence in support of 

the interpretation that minority students tend to perform 

better in integrated schools because of the differential 

characteristics of the student subculture* Furthermore, as 

Coleman notes : 

* This means that the apparent beneficial effect 
of a student body with a high proportion of white 
students comes not from racial composition per se, 
but from the better educational background and 
higher educational aspirations that are, on the 
average found among white students (p. 307)* 

Sbaycoft provides several notable illustrations of 

interpretation analysis in her report of Project TALENT data* 

Sbaycoft was interested in identifying the magnitude of the 

direct effect that socio*economic status had on grade twelve 

achievement* Consequently, the analysis of the influence of 

social class upon twelfth grade achievement was repeated after 

the effects of student aptitude, grade nine achievement, courses 

in high school and college plans were statistically controlled* 

According to Sbaycoft: 

After the effects of their various causative (or 
possibly causative) factors * * * have been elim- 
inated from the socio-econcnnic variable statis- 
tically, the part correlations of the residuals 
with grade 12 test scores are negligible (1967, 
pp* 8-214.) • 

Although this test was conceptualized as an attempt to 
estimate the direct causal relationship between social class 
and academic achievement, it also serves as an example of in- 
terpretation analysis* The results of this investigation in- 
dicated that tbe original relationship between socio-economic 



class and academic achievement was duei In large part» to the 
mediating Influence of those variables that were statistically 
controlled In the analysis. 

Bachman's analysis of the racial differences In the 
responses to a job ambitions Index Illustrates a systematic 
attempt to Identify an interpretation variable. Bachman found 
that the scores of Black students, regardless of whether they 
attended integrated or segregated schools » were lower than 
Whites on a scale presumed to be measuring the Job ambitions 
of the student* In search of an interpretation t Bachman ad- 
justed the scores on the basis of seven background character- 
istics and scores to the Ammons Quick Test of Intelligence. 
Although the racial differences did diminish in this phase of 
the analysis, the basic relationship remained; Blacks had 
lower Job ambitions than Whites. 

The a^nibitious Job attitudes index was composed of two 
major dimensions; attitudes toward Jobs "that pay off," and 
attitudes toward Jobs ^*that don^t bug me." Bachman surmized 
that a separate analysis of these two components of the 
original scale might reveal the reason for the racial differ- 
ences in the scores* Consequently, the analysis was repeated 
using these two dimensions as separate criterion variables • 
Accoxrding to Bachman, the results of this investigation were 
definitive: 

There are scarcely any racial differences in 
preferences for "a Job that pays off" . . . racial 
differences do appear when we consider nreferences 
for "a Job that doesn't bug me." Along this dimen- 
sion we find integrated blacks more than one-third 
standard deviation higher than whites; for northern 
segregated blacks the difference exceeds one-half 
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standard deviation y and for southern segregated 
blacks the difference reaches three-quarters of 
a standard deviation (1970, p. 114.7). 

Thus, the Black students in this sample were as equally 

ambitious as Whites for "jobs that paid off." However, the 

Black students were less tolerant than Vfhites of ^jobs that 

bug me." This led Bachman to conclude that: 

The young black high school student probably 
knows better than most whites what it means to 
have "a job that does bug me," and avoiding that 
* sort of job seems more important to him than to 
the average white. In our view, it is likely 
that some of the items on the "job that doesn^t 
bug me" scale mean something very special to 
black respondents, and that this, more than 
anything else, accounts for the racial differ* 
ences we have observed her (1970, p. 11^7). 

As previously noted, there are not many e^iamples of 
interpretation analysis in the Analytical Review studies. In 
some cases this was due to the lack of data. In many cases, 
however e analyst failed to perfom an inte3*pratation 
analysis whan, the necessary data were available. The work of 
Trent and Medsker (1966), Astin and Panoa (1969), Lehmann and 
Dreaael (1963)» and Hilton (1971) are cases in point. 

Trent and Medsker observed that socio«*economic class 
was moderately as&.ociated with college persistence in the ex* 
pected direction; the higher the social class standing of the 
student the greater the probability of persisting in college. 
In addition, acadmic achievement in high school and the amount 
of income earned from part time employment during college were 
also predictive of college persistence. College students who 
bad low academic achievement in high school or worked part* 
time for over half of their income were more likely to withdraw 



frcmi school than students who had high academic achievement In 
high school or did not work for over half of their annual In- 
come. Since data regarding two principal Interpretation vari- 
ables were available for each analysis — the academic ac?)levement 
of the student and bis emplo^rment — Trent and Medsker may bave 
been able to determine why lower class students withdrew from 
college at a greater rate than upper and middle class students* 
Unfortunately, bowever^ an interpretation analysis was not per- 
formed and as a result it is uncertain whether lower class 
students withdrew from college because they had lower academic 
ability or because they were employed* 

Astin and Panos missed several opportunities to statis- 
tically Interpret observed relationships* For example, they 
discuss tbelr observations of environmental effects by type of 
Institution (pp* ll|.l-ll|5) and the effects of specific environ- 
mental characteristics (pp* ll;5-ll|.7) under separate headings 
in tbelr report and never attempt to Integrate these two groups 
of findings tbrougb a systematic strategy of interpretation 
analysis* Instead, the researchers speculated that: 

« * • some of the environmental effects observed 
in particular '^types" of institutions may be wholly 
or in part a consequence of differences among the in- 
stitutions in some of the (environmental) character- 
istics described below (p. 11^5 )• 

The %ay oe wbolly or in part a consequence of** clause, however, 
represents an empirical question which could have been tested 
with the data that were available for analysis* 

Thus, Astin and Panos report that universities and 
liberal arts colleges bad very different dropout rates* Attri- 
tion at the liberal arts colleges was substantially lower than 
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would be expected on the oasis of student input ebaracterlstics* 
In contrast 9 tbe dropout rate at tbe university was greater 
than would be expected* The researchers also report that 
colleges with cohesive peer environments bad much lower drop- 
out rates than were predicted from student input characteris-* 
tics while colleges with fragmented peer environments showed 
the reverse pattern. These relationships suggest that liberal 
arts colleges have lower dropout rates than universities be* 
cause their peer environments are more cohesive ^ Clearly, 
this is a plausible interpret at ion that should have been 
tested* Unfortunately, the investigators failed to do so« 
Instead, Astin and Fanoa postulated the following alternative 
explanation: 

Although there are many possible explanations for 
the sharp contrast between liberal arts colleges 
and universities, one Interesting hypothesis is 
auggeated by the fact that these two groups of 
institutions differ markedly with respect to two 
environmental factors. Familiarity With The In- 
structor and Concern For The Individual Student* 
Perhaps the university professor, who spends rela- 
tively little time with bis students and much time 
in pursuing his own scholarly interests, provides 
a relatively poor role model in comparison with 
the college teacher, who often takes a more per- 
sonal interest in his students (p* 1U2). 

Even here, the investigators failed to test their inter- 
pretation* They could have statistically controlled for the 
items ^^Familiarity With The Instructor" and ^'Ccncern For The 
Individual Student^ to detertiine if these two variables did. 
In fact, interpret tbe relationship in question* Since they 
failed to perform this test, their Interpretation remains an 
unconfiraed speculation* 
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Lebmann and Dressel (1962) also misaed an opportunity 
to clarify tbe underlying proeerses of a major relationship 
reported in their study of Michigan State students. They 
found that religion was highly associated with a student^a 
value orientation and dogmatism score. Vhe apparent influence 
of the student's religious training was manifest in two related 
observations. First, Catholic students were more stereotypic 
and dogmatic than Protestants or Jews and were also more tra- 
ditlonal'value orientated. Jewish students, on the other hand, 
were more emergent in their value orientation than eitlier 
Catholics or Protestants. Secondly, students who had pre- 
viously attended public high schools were less dogmatic, stero- 
typic and more likely to be emergent in their value oriantation 
than students who had attended parochial schools. 

Tbe researchers also report that students' social class 
was associated with their value r>rientation8 and dogmatism 
scores. Students whose parents bad a high level education 
were less atoreotypic, dogmatic and bad more emergent value 
orientations than students whose parents bad little formal edu- 
cation. In addition, students whose fathers bad a bls^J occupa- 
tional rank were more emergent in their value orientations, less 
stereotypic and dogmatic than students whose fathers had a low 
occupational rank. 

Social class can often statistically interpret rela- 
tionships between religious affiliation and various cr-xterion 
variables. In this case, social class might have interpreted 
tbe relationship between religious affiliation and critical 
thinking, values, and attitudes. Thus, Lehni&nn and Dressel 
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could have determined whether the effect of the student's re- 
ligious background upon his value orientation and attitudes 
was due primarily to the influence of social class t or the 
more direct effects of religious training* Although a simple 
test of interpretation would have clarified this issue » the 
analysis was not performed and important information was lost. 

Evans and. Patrick (1971) conducted an analysis of high 
school dropouts from data derived from Hilton ^s study* In 
this investigation the analysts observed the expected relation- 
ship between the age of the student in the fifth grade, his 
scores on various SCAT and STEP tests, and withdrawal from high 
school. Fifth grade students who were later to drop out of 
high school tended to be approximately one year older than their 
classmates and obtain scores on achievement and ability tests 
which were significantly lower than those students who con- 
tinued through the eleventh grade. 

Certainly a critical question to ask at this point is 
wfay the older students in the fifth grade Jaada much greater 
probability of withdrawing from high school than the younger 
students. Age and achievement scores were both highly corre- 
lated with the criterion variable. In addition, the achieve- 
ment scores only explained about one percent of the variance in 
the dependent variable after the age of the student was intro- 
duced into the correlation equation. This suggests substantial 
scores. Thus, it seems plausible that the academic achievement 
of the student could serve as an interpretation test factor 
accounting for the relationship between age and v/ithdrawal 
from high schools In other words,, on the basis of the 
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existing data It could be argued that the students who were 
older in the fifth grade were less capable of performing well 
in high school and consequently were more likely to become 
frustrated^ disillusioned and finally to drop out of school 
altogether* 

Evans and Patrick, however, appear uncertain of the 

underl3ring process responsible for the association between 

student- age in the fifth grade and hi^ school persistence: 

Dropouts a^^rc nearly a year older in fifth grade 
than their non-dropout peers* The dropouts may 
have failed one or more grades or may have 
started school later than their peers* • * • 
Another possible explanation is that grade re- 
tention acted to cause dx'opping out, rather than 
simply predicting that a student would eventually 
drop out of school* The imnortant finding is 
that the age discrepancy is apparent as early 
as the fifth grade (p* 131)* 

Although the relationship between student age and 
vithdi*awal frcm higlh school was an important finding , it is 
also important to determine why age is a crucial factor in 
predicting the criterion variable* Interpretation analysis 
could have answered this question* 

Educational researchers in general have been negligent 
in conceptualizing^ measuring and testing interpretation vari- 
ables* As a result, thu systematic use of statistical inter- 
pretation has not been rigorously pursued in educational re- 
search* This is indeed unfortunate because the results of 
interpretation analysis can be tremendously enlightening to 
the researcher as well as to the educational policy-maker* 



Specification Analysis 

Specification analysis is another form of statistical 



elaboration which can be performed on a blvarlate relationship* 
Test;lng for specification, like interpretation analysis, in- 
volves statistically controlling the effects of a third variable 
Unlike tes^s for interpretation, however, successful specifica- 
tion analysis does not result in the disappearance of the orig- 
inal relation.ohip. Rather, the original relationship is 
strengthened or weakened, or the direction of the relationship 
is changed in the partial relationships « Thus, successful 
specification analysis identifies a third variable (i.e«, a 
specif icatioTi test factor) that statistically interacts with 
the original relationship by specifying the conditions which 
make the original relationship more or less probable. 

There are no time constraints on specification test 
factors* They can be antecedent, posterior, or simultaneous 
with the independent or dependent variables in temporal sequence 
In addition, successful specification analysis can frequently 
stimulate further elaboration* Thus, when specification has 
been observed, the analyst will usually ask why the original 
relationship was found to be conditional* This, in turn, could 
lead to an interpretation analysis* 

The results of systematic specification analysis can 
provide information that is of equal if not greater value than 
that obtained traai an interpretation analysis* For example, in 
order to achieve optimal allocation of school resources in terms 
of maximum impact upon the student population, it is necessary 
to determine which students will receive the greatest benefit 
from exposure to a particular school resource* The search for 
specification test factors will often identify variables that 
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strengthen or weaken the association between a school character- 
istic and a particular educational outcome « Frequently > these 
factors are student background variables. Thus, specification 
analysis can provide the investigator with valuable infomation 
concerning the differential Impact that certain schDol charac- 
teristics have upon different student subgroups* 

Coleman's study illustrates the importance of specifi- 
cation analysis in educational research* Coleman found that 
the student's academic achievement was only marginally affected 
by differences between schools. However, after a specification 
analysis was performed in which comparisons were made between 
racial and ethnic groups, important interschool differences 
emerged* In general, the variation in academic performance 
that existed between schools was noticeably larger for minority 
students than for majority students* This finding suggested 
that the academic performance of minority students was more 
sensitive to the impact of different school environments than 
was the academic achievement of majority students* As Coleman 
writes : 

Indirect evidence suggests that school factors 
make more difference in achievement for minority 
group members than for whites; for Negroes, this 
is especially true in the south* This result 
suggests that insofar as variations in school factors 
are related to variations in achievement, they make 
the most difference for children of minority groups 
(p* 297)* 

Coleman then continued this analysis by introducing 
data which indicated that the academic achievement of minority 
students was, in fact, more sensitive to the imnact of various 
school characteristics* For example, the magnitude of per- 
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numerous characteristics of the school facility, including the 
size of the school and the presence of laboratories, extra- 
curricular activities and guidance programs were found to have 
a larger iir.pact upon the academic performance of minority stu- 
dents than majority students* Tbus^ Coleman uncovered an im- 
portant specification teat factor that strengthened the asso- 
ciation between various educational experiences and academic 
acbievement* 

In a similar fashion. As tin and Panos tested for 

specification in their analysis of the quality of undergraduate 

Institutions and the student's intellectual achievement* The 

researchers stcte the major hypotheses of their investigation 

in the following manner: 

Stated in positive terms, the general hypotheses 
tested in this analyses were as follows; 

1. The academic excellence of the undergraduate 
institution - as defined by the level of ability of 
the student body, the level of the institution's 
financial resources, and the degree of academic 
competitiveness in the college environment - has 

a positive effect on the undergraduate student s 
intellectual achievement* 

2. The extent of the positive effect of 
institutional quality on intellectual achievement 
is proportional to the student's academic ability 
(1969, p- 72)* 

The second hypothesis incorporates a test for specification* 
That is, Astin and Panos propose that the effects of institu- 
tional quality will statistically interact with the student's 
academic ability to produce a higher association between the 
quality of the educational institution and the student *s in- 
tellectual achievement when the student has high academic 
ability* 
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The results of this analysis, however, provided little 
support for either hypothesis* The academic excellence of the 
school was not strongly or consistently associated with aca- 
demic achievement after the effects of student background 
characteristics were statistically controlled. Furthermore, 
the academic ability of the student did not significantly in* 
fluence the strength of the association between the quality 
of the school and the student ^s academic performance* 

Of course, the value of specification analysis is not 
restricted to policy-orientated research* The results of sys- 
tematic specification analysis can make an equally important 
contribution to the development of learning and socialization 
theory, as illustrated by the work of Kagan and Moss (1962)* 
In their longitudinal study of psychological develojxnent, Kagan 
and Moss consistently tested for specification by comparing the 
similarity of behavioral patterns between different time periods 
for both males and females. Many of their findings strongly 
support the hypothesis that early sex role identification has 
important implications for adult behavior. For example, Kagan 
and Moss report that a passive, in contrast to a retaliatory 
reaction to frustration, was highly stable for boys and girls 
during the first t^n years of life. However, early passivity 
in males was essenti <=>lly unrelated to adult behavior while it 
was moderately related for females. According to Kagan and 
Moss : 

The primary reason for this lack of continuity in 
males is the development of conflict over nassive 
and dependent behavior. A passive orientation to 
problems is inappropriate for the male role. ... 
This conflict, whieh does not swell to such strong 
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proportions in middle class girls, leads to 
minimal continuity between childhood and adult 
dependency for males (1962, p. 58). 

Thus, by focusing uuon sex as a specification test factor, 
Kagan and Moss were able to contribute valuable information 
supporting the notion that differential cultural expectations 
for dependency and passivity in males and females will influ- 
ence the pattern of psychological growth and development. 

. Bacbman (1970) also performed sp-cif ication analysis 
in bis panel study of adolescent boys. He originally found 
that majority and minority students attending integrated schools 
bad similar self-concepts of school ability, while Blacks in 
segregated schools bad somewhat lower self -concepts. However, 
the relationship was dramatically reversed when the scores were 
adjusted for a number of student background characteristics in- 
cluding social class and general intelligence. There was a 
pronounced tendency for Blacks attending either segregated or 
integrated schools to have relatively higher self-concepts of 
school ability than Whites. Furthermore, this same basic pat- 
tern was repeated for self-esteem. Southern segregated Blacks 
bad self-esteem scores that were similar to Whites, but after 
controlling for background characteristics and general intel- 
ligence, their adjusted scores were higber than Whites. Accor- 
ding to Bachm^n: 

It is frequently assumed that Black Americans, as 
a result of centuries of slavery and discrimination, 
have lower self-esteem than whites. This may be 
true of adults, but our data lead us to question 
this assumption as applied to young men in high 
school. . . . Our view is that the fairly high 
self-esteem scores for Black respondents represent 
a real feeling of self-worth (1970, p. 199). 
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The theoretical contribution of Bachnan's analysis was enhanced 
by systematically testing for specification. The results of 
this analysis not only uncovered an important relationship that 
was suppressed in the original analysis, but It provided valu- 
able information concerning the noasible changes in self- 
concept that may be occurring among minority students today. 

Despite its obvious value, researchers have not system- 
atically and uniformly introduced specification test factors 
into their analyses. Astin and Panos , for example, report that 
colleges which have a relatively large percentage of students 
who work for pay have considerably higher dropout rates that 
were predicted from student; input data. The researchers also 
had extensive information on the college environment; measures 
of the cohesiveness and competitiveness (vs. cooperativeness ) 
of the peer environment, various indicators of the classroom 
environment such as student involvement in the class and 
severity of grading practices, data on the administrative and 
physical environment of the school, student's subjective im- 
pressions of the college environment, the instructor's concern 
for the student, flexibility of the curriculum, and the degree 
of academic competitiveness • 

Valuable information could have been obtained if Astin 
and panes bad determined if these environmental factors spe- 
cified the relationship between student employment and college 
persistence # High school guidance counselors, for example, 
could use this information to advise students who anticipate 
working during college that they would have a greater probabil- 
ity of graduating from particular .types of schools (e.g., those 
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characterized by low academic competitiveness, liberal grading 
practices, or a cohesive peer environments )• Unfortunately, 
tests were not conducted using environmental data as possible 
specification test factors. 

The study by Trent and Medsker provides a number of 
similar illustrations* The researchers report, for example, 
that two-year college transfers bad a statistically higher rate 
of attrition than native students. A considerable amount of 
data on\ student background, family, and school envi:'onmental 
variables were available for analysis. Consequently, Trent and 
Medsker were in a position to identify situations or experiences 
that would increase tb« likelihood of transfer students persis- 
ting in college. The researchers, however, did not specify or 
interpret this relationship, and again valuable information 
was lost. 

The dearth of systematic specification analysis is 
evident in Project SCOPE. Tillery and associates (1972) re- 
port that in a subsample of students drawn from California, 
Illinois, Massachusetts and North Carolina, minority students 
(excluding Oriental Americans) tended to have lower educational 
aspirations than \ift)ite students. The researchers did not at- 
tempt to elaborate this relationship, however, by nerforming 
an additional analysis designed to identify specific educational 
experiences that contributed to the lower aspirations of minority 
stude nts. 

In addition, the data from this subsample indicated that 
junior colleges attract a similar number of students scoring at 
all four levels of an intellectual, predisnosition (IPD) test 
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consisting of items from the Thinking Introversion, Theoretical 
Orientation, and Autonomy scales of the Omnibus Personality 
Inventory (Center for the Study of Higher Education, 1962 )• 
It would have enhanced the contribution of this analysis if 
the researchers had identified the factors that increased the 
probability of a student with a high intellectual predisposi- 
tion enrolling in a junior college* Again, although the data 
were avfiiilable an important test for specification was not 
conducted* 

Opportunities to perform specification analysis were 
also missed in Project TALENT* Flanagan et. al. (1962), for 
example report that the size of the senior crlass and the aver- 
age class size were not highly associated with high school 
achievement (correlated below .20 with school achievement). 
No attempt was made to identify student background variables 
or other school characteristics that would increase or weaken 
the magnitude of these relationships. Consequently, no infor- 
mation was provided concerning the type of student who would 
benefit most from exposure to small classrooms. 

As a final example, Thistlethwaite (1965) reports that 

the student *s disposition to seek advanced training was: 

... strengthened by association with peers 
having high educational aspirations, favorable 
teacher evaluations of college performance, 
winning social recognition for intellectual 
achievement, participation in Honors Programs 
and graduate-level courses, and by under- 
graduate participation in research programs 
and projects (1965f PP* 91-92). 

The above relationships indicate the direct or indepen- 
^*nt impact of these college experiences upon the criterion 
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variable as determined by a multiple regression analysis. How- 
ever, these findings Pertain to students in general and not to 
particular subgroups of students. That is, Thistletbwaite de- 
termined that tbere was a tendency fur all students to seek 
advanced training if their peer groups had high academic aspi- 
rations or their teachers evaluated their academic performance 
favorably. Consequently, although Thistletbwaite reports that 
these college experiences ^'strengthened " the student's disposi- 
tion to seek advanced training, he did not perform a true 
specification analysis. 

While it is important to ascertain the independent 
effects that college experiences have upon the student's de- 
sire to seek graduate training, it is also important to deter- 
mine which students will benefit most from exposure to these 
experiences. In other words, what factors strengthen or 
weaken the association between participating in honors programs 
or receiving a favorable teacher evaluation and student dispo- 
sition to seek graduate training? These questions are truly 
representative of the types of questions asked in a specifica- 
tion analysis* Thistletbwaite did not attempt to answer these 
questions in his investigatipn. 

Educational researchers in general, and the Analytical 
Review investigators in particular, have not systematically 
tested for specification or interpret at ion ♦ Instead, they 
jeem preoccupied with developing prediction equations that link 
a number of independent variables to a specific dependent or 
criterion variable. 
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While it is generally recognized by theoreticians and 
metbodologists alike that the ability to accurately predict a 
specific educational outcome will yield valuable insights into 
the dynamics of the phenomenon in question, it is nonetheless 
important to remember that these causal or predictive relation- 
ships are not the only or necessarily even the most significant 
source of information* 

The most valuable scientific contributions are those 
which not only identify causal or predictive relationships but 
also e >llc&te these relationships by analyzing- additional 
variables that are not conceptualized as independent variables 
but as elaborating test factors. The discovery of a causal 
relationship does not signify the end of systematic inquiry , 
but the beginning* It is critically important to the advance*- 
ment of educational research and to the development of en** 
lightened policy recommendations that analysts introduce and 
subsequently test hypotheses which identify (l) the reasons 
why a specific relationship exists (Interpretation) and (2) 
the conditions that maximize and minimize the strength of the 
relationship (specification). A serious effort should there- 
fore be made to supplement the current orientation of simply 
predicting specific educational outcomes with one that empha- 
sizes the need to explicate predictive or causal relationships 
with interpretation and specification analysis « 

Accordi. zljf it is recommended by the Analytical Review 

staff that: 

Investigators should be required to develop 
a conceptual model that identifies specific 
variables to be used as Interpretation and 
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specification test factors In addition, each 
ma or hypothesis of the Investigation should 
be outlined and discussed in terms of which 
variables will be used to interpretand specify 
the expected results 
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ADDENDUM 



An Analytical Review of Longitudinal and Related Studies 
tbey apply to the Educational Process* 



Gersty A* and Trent, J. V. Preliminary Report ♦ Vol I. Center 
for the Study of Evaluation, University of Calif oraia, 
Los Angeles, 1970* 

Roset C*f Trent, J* W*, Solyard, A* and Adams, J* Towards 

Synthesis ^ Vol. II» Center for the Study of Evnlualion, 
University of California, Los Angeles, 1972. 

Marcus, A* C«, Keesling, J* W* , Rose, and Trent, J« W« 
Hethodologlcal Foundations for the Study of School 
Effects , Vol^ III^ Center for tho fStudy of Evaluation, 
ffnivers Ity of California, Los Angeles, 1972* 

Rose, G# and Trent, J. W. Research in Retrospect; Imolications 
for the Future , Vol. IV. Center for the Study of 
Evaluation, University of California, Lo<i Angeles, 1972 • 

Trent, J. W. and Rose, C. A_ Sunulement to the Analytical Review , 
Vol. V. Center for the Study of Evaluation, University 
of California, Los Angeles, 1973 « 
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